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Abstract — The Mobile Exploration System Project (MEX) 
at NASA Ames Research Center has been conducting stud- 
ies into hybrid communication networks for future planetary 
missions. These networks consist of space-based communi- 
cation assets connected to ground-based Internets and plan- 
etary surface-based mobile wireless networks. These hybrid 
mobile networks have been deployed in rugged field loca- 
tions in the American desert and the Canadian arctic for sup- 
port of science and simulation activities on at least six occa- 
sions. This work has been conducted over the past five years 
resulting in evolving architectural complexity, improved com- 
ponent characteristics and better analysis and test methods. 
A rich set of data and techniques have resulted from the de- 
velopment and field testing of the communication network 
during field expeditions such as the Haughton Mars Project 
and NASA Mobile Agents Project. 

This paper will define design, analysis and test methods for 
hybrid mobile communication networks, identifying the key 
issues and constraints that affect performance in both the ra- 
dio frequency (RF) and network engineering disciplines. Pre- 
vious work by the MEX team has addressed the architecture 
and detailed analysis of wireless networks including the re- 
sults of field tests. We will continue the analysis using a new 
802.11b backbone utilizing two repeaters that significantly 
increase range and coverage but greatly increase latency, 
which reduces overall network throughput. The addition of a 
satellite link can result in significant additional throughput 
loss due to light-speed delays in the space segment interact- 
ing with variable latencies in the multi-hop wireless network. 
The paper will analyze and present RF domain field test re- 
sults combined with network performance metrics which de- 
scribe a comprehensive approach for designing and optimiz- 
ing future hybrid mobile networks. 
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1. Introduction 


The Intelligent Mobile Technologies (IMT) group at NASA 
Ames Research Center has been providing the basic compu- 
tational and communication infrastructure required for the 
conduct of sophisticated planetary exploration simulations 
in remote rugged field locations around the globe. These simu- 
lations focus on both exploration technology development 
such as autonomy software and the operations concept de- 
velopment for missions involving mixed human and robotic 
teams. This work was initiated in 1998, and the IMT group 
has been involved in no less than eight different field expedi- 
tions to the Canadian high Arctic and the American South- 
west deserts. Despite the differences in temperature, these 
locations are remarkably similar in their barren, harsh envi- 
ronments, supporting only occasional plant life in distinct 
ecological niches but providing a rich environment for the 
study of geology and biology relevant to extreme environ- 
ments. In fact, NASA scientists select these “Mars analog” 
sites based on their similarity to anticipated Martian terrain 
and environmental conditions. An important selection crite- 
rion is the quality of science that can be performed at these 
earth sites — relevant to current earth science goals and the 
goals of astrobiology, the study of life on other planets. 
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The Mobile Exploration System (MEX) is an IMT project 
that develops increasingly capable infrastructure for these field 
science surveys and exploration technology simulations. Both 
activities can occur in concert during expeditions such as the 
Haughton-Mars Project [1] and the Mobile Agents Project 
[2]. The MEX infrastructure models a communication and 
computational system that provides connectivity and com- 
puting functions between astronauts conducting a field sci- 
ence survey in a remote location to a habitat module acting 
as the primary planetary base and finally over a space link to 
earth-based mission control and science centers. MEX at- 
tempts to construct advanced capability using current tech- 
nology to meet the goals of both high-fidelity simulations 
and the support needs for conduct of theses simulations by 
providing a satellite based wide-area network (WAN) uplink 
to a collection of computing assets at the habitat and extend- 
ing this connectivity to remote field locations using wireless 
network (WLAN) technology. 

The MEX 2003 field configuration is shown below (Figure 
1) and illustrates the use of two repeaters to form a long-haul 
backbone to remote survey sites up to 5 miles away. The back- 
bone terminafe.s at the All-Terrain Vehicle (ATV) used to 
host the major computing and sensing assets. The ATV cre- 
ates a local 802. 1 lb cluster which supports the astronauts, 
wearing computing and communication backpacks and vari- 
ous other computers and sensors. The Mobile Agents simu- 
lation scenario has the astronauts issuing voice commands to 
the astro backpack which are then executed by distributed 
software agents to take pictures, command rovers and trans- 
fer data. 


Previous work in this area has resulted in papers that describe 
hybrid architectures for planetary communications and the 
test methods applicable to mobile networks. This paper is a 
continuation of this work, now extended to incorporate the 
habitat-wired networks and the space-based satellite links to 
the Internet. There is an interaction that occurs between such 
disparate communication systems that can significantly de- 
grade performance if not properly addressed. Specifically, 
high latency on the space-based links can interact with the 
variable latency on the WLANs and result in low TCP/IP 
throughput. Solutions resulting from architectural improve- 
ments and tuning of the links are presented. Extensions of 
these methods to longer light-speed delays typical of satellite 
communication links are introduced. Finally, the results of 
field deployment and testing of the MEX 802.11b wireless 
backbone is presented and compared to the results of other 
WLAN products tested earlier. In this paper, we attempt to 
illustrate how the general design of hybrid complex commu- 
nication systems can only be addressed by concurrent solu- 
tions in the radio frequency domain, the WLAN packet do- 
main and the TCP/IP domain. 

2. Communication Architecture Ovfrvtfw 

The MEX communication architecture is intended to be a 
prototype for any future network system that could be de- 
signed and used for planetary exploration. It incorporates all 
the major elements: Earth-based Wide Area Networks, space- 
based satellite links, habitat vehicle wired networks, habitat 
vehicle wireless networks, planetary-surface wireless back- 
bones and cluster WLANs supporting field survey vehicles. 


Figure 1 - Mobile Exploration System Field Configuration 2003 
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space suits and instruments. It provides all the services re- 
quired for mission situational awareness and direction, sci- 
entific data acquisition and analysis and all system and per- 
sonnel support services. In addition, it provides a superset of 
services for support of the field expedition itself and for the 
conduct of the simulations such as internet telephony, video 
teleconferencing and Internet access and e-mail. For example, 
as three people are involved in conducting a real-time simu- 
lation of science surveys in the field, up to 20 people are 
involved in supporting the system and software functions 
needed to conduct the simulation. 

Applications required in the field such as Voice over Internet 
Protocol (VoIP), and Internet-based video conferencing and 
streaming video can drive network bandwidth and latency 
requirements. These applications require near real time re- 
sponse and have the following attributes: Packet voice and 
video use the User Datagram Protocol (UDP) meaning that 
this data is not subject to the delays inherent in Transmission 
Control Protocol (TCP) which must receive a reply after a 
series of packets are sent. UDP sends data in a continuous 
stream without regard to the state of the receiver. A small 
data loss (or errors) ear. also be tolerated with voice and video 
transmissions, resulting in some inconsequential loss of qual- 
ity. Jitter (variable delay between packets), caused by net- 
work latency and out of sequence packets, can cause prob- 
lems with voice and video processing that depends on syn- 
chronous packet transfer. 

Voice and streaming video are basically half duplex, mean- 
ing that they are transmitted in one direction at a time. With 
VoIP there can be more than one conversation at once mean- 
ing that packets could be flowing in both directions (full du- 
plex). Video conferencing is always full duplex since images 
are flowing in both directions so the party at either end can 
see the other. This factor is especially important for trans- 
mission over WLANs, which are half duplex in nature with 
highly variable latency. Another problem is that TCP and UDP 
are not very good at sharing network links. TCP tends to cut 
back on its transmission rate when packets are dropped and 
routers tend to drop UDP packets in undesirable ways when 
congestion occurs. VoIP products have developed means to 
compensate for echo and the long but consistent delay of sat- 
ellite links. Video conferencing equipment however can be 
problematic because satellite links are usually asymmetrical 
having different bandwidth in each direction. NASA ARC is 
now using network monitoring to determine the requirements 
and problems associated with these applications in the field 
environment There exist Quality of Service techniques that 
can mitigate the problems with sending voice and video on 
constrained WLAN links, to be explored in future papers. 

An end-to-end analysis of the communication paths required 
to acquire a digital picture from a camera in the astronauts 
hand to a scientist located on earth shows how many links 
and computational nodes are involved in this data transfer. 
The computing nodes are critical to communication system 


function and performance because they can buffer and store 
data between link segments, with a dramatic effect on com- 
munication system performance. The data path is essentially 
from camera through camera interface (wireless Bluetooth 
or USB) to astronaut computer to ATV cluster WLAN, to 
ATV computer, to MEX backbone WLAN, to habitat net- 
work and computers to satellite dish transceiver (via wireless 
link) to satellite to ground station to Internet router through 
Internet to Science Center network to scientist workstation. 
This is a total of at least ten discrete links or hops! The MEX 
network architecture is designed to be a unified subnet, with 
the ATV and astronaut nodes accessible directly from the 
habitat Actual systems for Mars exploration will be even more 
complicated, but the design issues are similar - allowing us 
to define and test prototypes, which have relevance to sys- 
tems to be designed ten years hence. 

This paper analyzes the wireless network backbone in detail, 
using RF domain analysis to determine the range and cover- 
age of a given link segment. It looks at theoretical and mea- 
sured RF received signal levels using various combinations 
of antennas and compares these reference values to field-test 
values during deployment in the Utah desert. Other factors 
affecting link performance in the RF domain, such as antenna 
height and multipath, are discussed in detail. Then the effects 
of Media Access Control (802.1 lb) layer on digital packet 
transport are analyzed, looking at the effects of bit error rate 
on throughput. Finally, the paper will show several measure- 
ment methods used at the Internet Protocol transport layer to 
determine network throughput under various conditions us- 
ing single and double repeater systems. The effects of latency 
on throughput are detailed, along with mitigation techniques 
such as window size adjustment and buffering. Detailed quan- 
titative analysis of RF signal strength correlated with net- 
work throughput and latency is presented and compared to 
the field-test results. 

3. Radio Frequency Domain Analysis 

Theoretical Link Margin Calculations: 

Wireless networks use RF signals (or optical signals) to com- 
municate information from point to point. The theory of RF 
propagation is well developed and understood and can be 
applied directly to WLANs. Basically, a transmitter with a 
certain amount of output power sends its signal through an 
antenna that focuses the radio signal into a directional beam, 
amplifying it in relation to an isotropic radiator. This effec- 
tive radiated power (EIRP) is the radio signal power leaving 
the transmitter antenna. When propagating from transmitter 
to receiver it suffers significant signal loss from attenuation 
caused by spread of the radio beam with distance (d), a phe- 
nomenon known as free-space-path-loss (Ls), given by the 
following equation in dB: 

Ls = 36.57 + 20(log(d/5280*39/1 2*2442) [3] 

where d is in meters 



The receiving antenna collects the remaining signal at the 
end of the propagation path and passes it to the receiver. The 
receiver has a certain sensitivity that allows it to interpret the 
information coded into the RF signal. The received radio sig- 
nal strength must be greater than the specified sensitivity for 
the information to be recovered. The sum total of these fac- 
tors governing radio transmission is termed the “link bud- 
get” and is given by the Friis equation: 

Lm = P r = P t + G( - L fe - L x + G r [4] 
where 

Lm = maximum link margin in dB 
P r = power at the receiver (dBm) or 
received signal strength 
P t = transmitter output power (dBm) 

G t = transmit antenna gain (dB) 

L fs = free space path loss (dB) 

L x = extra losses (e.g. cable and connectors ) (dB) 

G r = received antenna gain (dB) 

The result of this calculation is a value of received signal 
strength at the far end of the link segment. Since antenna 
gain and cable losses are constant, a plot of Pr versus dis- 
tance will produce an exponential fall-off of received signal 
strength with distance, producing the attenuation curve based 
on RF propagation theory. The units used for these calcula- 
tions are power decibels (dBm) described by the equation: 

Pt = 10 log Po/Pr 
where 

Po is power output 

Pr is reference power of 1 raW. 

This means a 100 mW transmitter would be characterized as 
having a +20 dBm output signal. A decrease of only 3 dBm 
in signal strength implies that half the original power is now 
available, an indication of the logarithmic nature of these 
numbers. Antenna gain is expressed as the decibel equiva- 
lent compared to an isotropic (equal radiation in all direc- 
tions) radiator in units of dBi. Cable and other parasitic losses 
are similarly expressed as dB losses per meter or loss per 
connector. These parasitic losses can be a significant factor, 
especially at frequencies of 2.4 GHz, used by 802.11b 
WLANs. 

The maximum distance that can be supported by a communi- 
cation link is proportional to the square root of the power 

Table 1. Grid Dish-to-Grid Dish Antenna Link Calculation 


received — if we increase the received power by 6 dB, or 
quadruple it, we will double the maximum distance. This is 
expressed in the formula: 

Dm = 300/2442 * exp((Lm-22-Rm)/6 * In2)) [5] 

where 

Dm is distance in meters 

Lm is maximum link margin in dB 

Rm is desired receiver signal to noise margin, 
typically 10 dB over sensitivity rating 

For example, we will model our MEX field repeater link, 
which used an 18 dBi parabolic dish at both ends, with 
100 mW of transmit power and about 3 dB of cable and con- 
nector loss at each end. The calculation yields a maximum 
distance of 11.13 miles or 18.07 Km, as shown in Table 1, 
below. 

These equations can be used to predict received signal strength 
and therefore performance at specific distances for various 
radio and antenna combinations. They can also predict maxi- 
mum distance for a given link configuration and form the 
basis of lauio system design. However, many other factors 
can affect radio propagation and we apply pragmatic meth- 
ods as well as theory. 

WLAN Product Calibration Curves 

To determine how well the radio engineer has setup a given 
link segment, one can measure the performance of a WLAN 
system and compare these test results to the theoretical curve 
of received signal strength versus distance. There should be 
a reasonable correlation with theory and if not, there is some 
problem with the setup. However, the measurement tools 
generally provided with the WLAN systems are not calibrated 
and much too inaccurate for this purpose. Each WLAN prod- 
uct line comes with software tools to assist the radio engineer 
in setting up and analyzing the RF domain characteristics of 
the WLAN under actual conditions by measuring RF signal 
strength and signal quality under controlled conditions. Most 
products provide qualitative values and these measurements 
are generally inaccurate. Some products provide quantitative 
values, but these values seldom correlate with the values used 
in the theoretical calculations described above. The reason 
for this discrepancy is different assumptions regarding an- 
tennas, additional losses, non-linearity of the RF circuits and 
other factors not included in the WLAN tool’s calibration. 
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Figure 2 - MEX Link Test Range Diagram 


ic measured usinc thsss 
tools needs to be correlated with the numbers obtained from 
the theoretical RF link equations, which are correct from the 
radio physics viewpoint. Then the numbers obtained from 
the WLAN tools can be translated into the correct physical 
units and accurately used to predict link performance in vari- 
ous field conditions and for determining how well a given 
link has been setup and is performing. 


W'e use measurements taken in the field under controlled 
conditions to create calibration curves for the RF site survey 
tools provided with each WLAN product line. The controlled 
conditions are precise antenna and cable construction and 
alignment, a test range free of interference or physical ob- 
structions and a careful procedure for conducting the tests. 
We then use certain techniques to normalize these WLAN 
product values to the theoretical calculations and values. This 
yields the ability to apply the crude WLAN tools quantita- 
tively for estimating maximum range or for determining how 
well a given installation is performing. The process is to curve- 
fit the WLAN tool received signal graph to the theoretical 
received signal graph, taking into account certain factors, such 
as parasitic losses and atmospheric absorption of the RF sig- 
nals. The parasitic losses are constants and appear as an off- 
set between the two curves. The additional loss due to atmo- 
spheric absorption is proportional to distance and appears as 
a change in slope between the two curves. Determining the 
values of these additional 2nd order effects can be difficult if 
the two graphs are significantly discrepant. 


Our radio test range is shown schematically in Figure 2 with 
Link 2 (L2) being the one under test. Link 1 (LI) consisted 
of a fixed link between the root bridge indoors inside our lab 
and the first repeater approximately 60 meters away, located 
across the street outside of the building but well within line- 


of-sight of the root. The root bridge, using a single rubber 
2.2 dBi dipole antenna, communicated to the first repeater 
equipped with a directional 1 8 dBi small dish grid antenna to 
complete L 1 . The Cisco 350 Bridges were equipped with two 
RP-TNC connectors for antenna attachment, and a low-loss 
cable of about 15 feet length was used to connect the repeater 
box to the antennas, which were mounted on separate an- 
tenna masts at the first repeater site just outside our building. 
The two masts were about six feet apart and the antennas 
were mounted about 6 feet high. 

J ink 2 consisted of a 13 dBi sector pane! antenna at the first 
repeater site aimed down the length of a long street perpen- 
dicular to Link 1 . The elevation angle was zero degrees, as- 
suring optimal transmission to the ATV antenna mounted at 
a similar height. Buildings on either side but offset from the 
street allowed for an open thoroughfare of 60-90 meters down 
most of the street, finally opening up entirely on the far end 
of Link 2. The distance of Link 2 varied with each test point 
that were located at approximately 30 meters, 80 meters, 160 
meters. 320 meters and 500 meters from the first repeater. 
The farthest measured point from the first repeater was 840 
meters away and located on the opposite side of a large field, 
with mostly low-lying brush between this point and all other 
points located along the street. The only other objects to pose 
a possible obstacle were parked cars and the occasional stop 
signs along the street. Our test platform was the ATV. with 
two main antenna types, dipole and Yagi mounted on an ad- 
justable arm above the rear platform around six feet high. 
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Graph 1 - Signal Strength Calibration — Sector Panel to Dipole 


We will use three examples to illustrate this technique for the 
Cisco 350 Bridge units used for the MEX backbone. Graph 1, 
above, shows the calibration curve obtained in the field us- 
ing the antenna-pointing tool on the Cisco 350 Bridge, which 
produces RF signal strength values in dBm units, not neces- 
sarily accurate from a physics perspective. It also produces a 
signal quality number expressed as a percentage, with 100% 
being excellent quality. Quality is generally the ability to in- 
terpret the data modulated into the radio signal and is affected 
by multipath interference and other signal scrambling effects. 
Signal strength is affected primarily by path loss for a given 
antenna combination with fixed parasitic losses. The values 
for RF signal strength obtained from theory are shown on the 
same graph. Note that the theoretical received signal strength 
conforms to the expected exponential dropoff with distance. 

The first case tests link L2 between the repeater and ATV 
using a sector panel antenna with 13 dBi gain on the repeater 
and an omni directional dipole antenna with 5 dBi gain on 
the ATV. The numbers for the link calculation are shown in 
Table 2, yielding a modest 1.4 miles of distance for this 
configuration. 


Table 2. Sector Panel to Dipole Antenna Link Calculation 


Graph 1 illustrates the difference between the measured re- 
ceived signal strength value using the Cisco antenna-point- 
ing tool and the theoretical link calculation. Visual compari- 
son shows that the scale and offset of the two curves are dra- 
matically different, with the measurements showing much 
higher values then theory. In this case, the two curves are so 
different that a lookup table approach should be used to in- 
terpret the numbers. If we want the theoretical equivalent 
we lookup the measured value on its curve and simply read 
the corresponding theoretical value by going down vertically 
on the graph. 
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Graph 2 - Signal Strength Calibration - Sector Panel to Yagi 


For the second case, the dipole is replaced with a Yagi direc- 
tional antenna, yielding an increase in link gain and therefore 
maximum range. This is shown in the link calculation table 
(Table 3, below). A difference in 8.5 dB yields more than 
double the maximum distance, as expected, since a 6 dB in- 
crease in signal strength will double the range according to 
the link equation. 

Graph 2, above, is for Case 2, using a sector panel antenna 
with 13 dBi gain for the repeater and a 13.5 dBi Yagi antenna 
for the ATV. When we compare this graph to the previous 
one, the first thing to observe is that the two theoretical curves 
are identical, just offset by 8 dB. reflecting the higher gain of 
the Yagi antenna. Fixed differences in link gain are revealed 
as offsets between the two received signal curves. However, 
when the two measured curves are compared, there is no fixed 
offset. At 320 meters, the offset is 22 dB, at 480 m it is 3 1 dB 
and at 840 m it is 28 dB. The measured values are much higher 
than the theoretical values generally and fail to exhibit the 
exponential drop off expected, especially at short distances. 


In fact, the curve for Case 2 is flat until 280 meters! After 
that, the curve tends to fall off linearly with distance, again 
the opposite of theory, which has it flattening out at larger 
distances. Obviously something is very wrong with the num- 
bers coming from the Cisco WLAN tool. Not only are the 
numbers wrong, the curve has the wrong shape. 

How can we validate our table lookup scheme, which pro- 
vides normalized theoretical values from the measured val- 
ues provided by the WLAN tool? We are comparing two links 
where the only difference is one antenna, allowing direct 
comparison of the two sets of numbers from the two differ- 
ent link configurations. This provides a crosscheck on the 
accuracy of the technique. The reduction of overall link gain 
caused by using a lower-gain omni-directional dipole antenna 
at the ATV is evident from inspecting the two graphs which 
shows higher measured and theoretical numbers with the Yagi. 


Table 3. Sector Panel to Yagi Antenna Link Calculation 
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To demonstrate the accuracy of the normalization technique 
using table lookup, we chose two data points in the linear 
range of each graph, representing -22 dBm and -47 dBm mea- 
sured from the Cisco bridge. Table 4, below, shows the cor- 
relations with distance and theoretical received signal strength. 

The correlation of theoretical received signal strength to Cisco 
tool received signal strength is good within 2 dBm for very 
different link configurations. Note that the reduction in dis- 
tance between the two configurations is nearly what is ex- 
pected from a reduction of 8.5 dB of link gain. This validates 
both data sets and the calibration technique. 

An additional crosscheck is provided by means of a firm- 
ware upgrade to the Cisco bridges, which could affect the RF 
signal levels, since these are provided through the firmware. 
We needed to obtain calibration curves of the firmware used 
in previous field tests, so that the field data could be ana- 
lyzed, but for future field tests, we need to use the upgraded 
firmware. Graph 3, above, shows a repeat of the Sector Panel 
to Yagi case 2 test, but using firmware version 12.03 rather 
than version 1 1.03. The measured curve on the graph is com- 
pletely different, even though the theoretical curve is the same 
as Case 2. The firmware upgrade did address the calibration 


of the RF signal strength measured value and actually 
achieved a reasonable fit with the theoretical curve! One sig- 
nificant difference is that the measured value is now lower 
than the theoretical value, below -50 dBm, which still neces- 
sitates using this normalization technique even with the firm- 
ware upgrade. We determined that the bottom value of RF 
Signal Strength is -91 dBm, corresponding to the sensitivity 
specification for the Cisco Bridge at its lowest data rate. 

The gold standard for RF signal measurements is the spec- 
tram analyzer, which produces a plot of RF energy versus 
frequency over the band of interest. The MEX project is ac- 
quiring such an instrument (which is quite expensive for fre- 
quencies above 1 GHz) and will compare these results to this 
instrument at a later date. These instruments use calibrated 
antennas to sample the radio signals they are measuring, and 
this is a source of significant error due to misalignment or 
other errors in measurement technique. Therefore, the meth- 
ods outlined in this section are also relevant to validate the 
measurements obtained using precision instruments. The most 
important contribution of this analysis method is the ability 
to correlate multiple instruments. The technique for doing 
this is to use a calibrated test range and procedure. 


Table 4. Comparison of Normalization Technique for Case 1 and Case 2 
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Figure 3 - Fresnel Zone and Antenna Height 


Fresnel Zone and Antenna Height 

Another primary factor for RF propagation is the Fresnel zone, 
which has implications for antenna height and line-of-sight 
considerations. The Fresnel zone is the area required to effi- 
ciently propagate the RF energy so an antenna can receive it. 
The propagating wavefront actually has to occupy a certain 
area for enough energy to be transmitted, and this area is ex- 
pressed as a circle with a given radius perpendicular to the 
propagation direction. This radius describes the Fresnel zone 
area and is proportional to the wavelength of the RF energy 
and proportional to the distance from the transmitter. Figure 
3, above, has a table for Fresnel zone size at various distances 
for the 2.4 GHz WLAN band. The picture illustrates how' 
Fresnel zone affects the required height of the antenna at vari- 
ous distances. Basically, the antenna has to clear the earth 
bulge between the transmitter and receiver by at least the 
Fresnel zone defined in this case as being the size of the area 
required for 60% of the transmitted energy to get to the re- 
ceiver. Partial blockage of the Fresnel zone will result in lower 
energy in the link, with concurrent reductions in RF signal 
values and link performance. Our test range barely conforms 
to this requirement at the longest test distance of 840 meters. 
Note how tall the antennas need to be to cover substantial 
distance even at this high frequency. 

Other RF Domain Effects 

There are other physical effects on radio propagation relevant 
to WLAN design, which are not accounted for in the theo- 
retical link calculations. One such effect is atmospheric loss, 
which scales with distance through the atmosphere. This ef- 
fect is particularly important in the 2.4 GHz band, since this 
band is in the water window, where water vapor can absorb 
the incident RF energy. A previous paper attempted to define 
this loss and arrived at a value of 0.01 dB/m. [6] For the maxi- 


mum test distance, this would be about 8.4 dB of additional 
loss, a significant difference. Note that the measured curves 
show a larger drop off of received signal strength at larger 
distances and that this effect could contribute to this differ- 
ence. These additional effects all reduce the link gain and 
therefore the maximum distance. The theoretical calculations 
really should be considered the best-case values. Future work 
with precision spectrum and power analyzers will attempt to 
define the atmospheric loss factor more precisely, since it is 
relevant for long distance links. 

Another major effect is multipath interference, which has the 
effect of reducing the operating range of a WLAN by affect- 
ing the information content of the signal rather than its RF 
signal strength. When a link has high RF signal strength, but 
low bandwidth, this is a multipath effect in which a reflected 
wave interferes with a direct wave from the same transmitter, 
effectively overlaying part of the information content. Under 
extreme circumstances, this direct and reflected energy can 
setup standing waves where the RF signal strength varies dra- 
matically by location, reaching peaks and nulls related to the 
wavelength of the RF energy. This effect is predominant in 
802. 1 1 b systems, since they offer no information redundancy 
which might mitigate this effect. In the field, when we ob- 
serve a strong reflection situation, we also see a significant 
concurrent reduction in link throughput and reliability. The 
use of directional antennas can mitigate multipath distortion 
by selecting only the primary direct beam of energy from the 
transmitter. 

Two other phenomena directly affect link gain. Antenna point- 
ing accuracy is the angular alignment of one antenna to the 
other producing maximum gain. Accurate alignment will pro- 
duce the specified gain of the antenna and misalignment will 
decrease it, perhaps drastically. The antenna radiation pat- 
terns show how accurate the pointing needs to be for both 
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azimuth and elevation angles. Generally, mounts accurate to 
a fraction of a degree are desired for long-haul links, a real 
problem for mobile repeaters. The second phenomenon is the 
polarization direction of the electromagnetic wave. Certain 
antennas, such as sector panels, produce electromagnetic ra- 
diation that vibrates in only one direction, for example, verti- 
cally. The corresponding receiving antenna must also be ca- 
pable of receiving the energy in this polarization plane. If it 
is horizontally polarized — for example, it will not “see” the 
vertically polarized signal. This can be responsible for low 
received signal strength. 

4. Media Access Control Packet Domain 

The Media Access Control (MAC) layer specification for the 
Cisco WLAN is the IEEE 802.1 lb standard, corresponding 
to the 802.2 standard for wired Ethernet packets. The MAC 
layer is the physical transport layer for digital data. The MAC 
layer specifies the manner in which the physical medium for 
information transfer is used to provide multiple node access 
and for the transmission and interpretation of digital packet 
data. The 802.11b MAC specifies Carrier Sense Multi-ac- 
cess; client device association and authentication to an ac- 
cess point; request-to-send and clear-to-send handshakes; and 
the format of the radio data packets and acknowledgements. 
This is similar to the Ethernet access protocol and packet for- 
mat used for wired LANs but in the radio domain. Certain 
effects occur in WLANs that do not generally occur in wired 
LANs. 

The first specification applied to physical data communica- 
tion links is the Bit Error Rate, or BERR, which specifies the 
rate at which bits are corrupted by noise, interference or in- 
ability to correctly decode the information contained in the 
radio signal. For wired media, this can be on the order of 
only one lost bit per 10 12 bits or a BERR of 10 12 . However, 
for radio links this value is much higher, typically a loss of 
one bit per 10 9 bits for a BERR of lCf 9 . Once a single bit is 
lost, the entire packet of data containing that bit needs to be 
retransmitted. Each packet contains about 1 Kbytes of data, 
or 8 Kbits of data, therefore a single bit error will incur a cost 
of transmitting the corrupted 1 KB packet again. The time 
cost on an 1 1 Mbps link would be about 800 usee. The net 
result of a high BERR is that many radio packets will need to 
be retransmitted, resulting in much lower network through- 
put and higher and more variable data transmission latency. 

Multiple effects can cause high BERR, necessitating effec- 
tive analysis of root cause to correct the problem. If the RF 
signal strength is too low, the receiver is unable to resolve 
the modulated data in the signal, and many bit errors can oc- 
cur. This is what happens when the distance between trans- 
mitter and receiver is too large, or when antennae are mis- 
aligned or there is a significant obstruction of the Fresnel 
zone. However, low RF signal strength is not the usual cause 
of these types of problems. Multipath interference or distor- 
tion is usually responsible for high BERR in 802.11b sys- 


tems. The 802. 1 1 b system uses a direct-sequence spread spec- 
trum modulation scheme for encoding the data into the radio 
signal. Essentially up to one third of the 2.40 GHz to 2.483 
GHz frequency band is used to transmit the full bit rate si- 
multaneously. Interference in any portion of this active band 
will corrupt the bits corresponding to that portion of the RF 
spectrum, resulting in significantioss of data and high BERR. 
Multipath occurs when a reflected part of the transmitted ra- 
dio signal interferes with a direct beam of the same transmit- 
ted signal. This will corrupt certain segments of the radio 
signals in the spread spectrum resulting in loss of the corre- 
sponding information content. Although the effect occurs in 
the RF domain, its effects are apparent at the packet layer. 
This effect can be very severe for 802.1 lb, essentially shut- 
ting down the link despite very strong received signal levels. 

A strong reflection from a building or hill can produce a very 
strong multipath effect with a corresponding large reduction 
in link throughput. A series of small reflections can also cause 
the same effect, but in a more subtle manner. The term for 
this is ground scatter, which occurs when part of the trans- 
mitted radio signal hits rocks, plants and other objects on the 
ground between the transmitter and receiver. These small 
objects scatter the radio signal by reflecting just a tiny por- 
tion of it. The aggregate sum of this scatter can reduce net- 
work throughput by increasing BERR. We have been trying 
to quantify the effects of multipath and scatter on through- 
put, but are having difficulty producing repeatable test 
conditions. 

The instruments used for radio packet analysis are called pro- 
tocol analyzers. They actually intercept and interpret each 
802.11b radio packet and can determine collision rate and 
BERR, and can measure latency of packet transmission. They 
can also identify access points and associated clients by MAC 
address. The MEX project has applied them in the field but 
has not performed the controlled testing needed to validate 
and interpret the results. This is a future effort. 

The MAC layer is the physical foundation for data commu- 
nications in networks. However, for WLANs, the MAC layer 
often obscures the actual performance of the WLAN because 
it will automatically retry transmission at the MAC packet 
layer in case of packet loss. Successful retransmission will 
only incur a delay in data transfer and will prevent the packet 
loss from being seen at the higher levels of the network stack. 
The MAC layer is responsible for all media access handshakes 
and for RF packet transfer and error handling, as well as re- 
peater turnaround from transmit to receive mode. The timing 
of these processes varies from product to product and MAC 
layer software versions. The aggregate effect of these MAC 
layer timing interactions is difficult to predict, but have the 
effect of increasing latency, increasing latency variability and 
decreasing throughput if not optimal. However, there are ways 
to measure these effects indirectly by applying benchmark 
metrics at the transport layer. 
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In fact, the method of predicting network throughput in com- 
plex WLAN systems is to use simulations of MAC layer func- 
tion in tools such as OpNET. [7] Since the MEX project is 
primarily involved in providing functional WLAN capabil- 
ity in the field, our methods are the experimental equivalent 
of simulations, running the desired WLAN configuration 
under ideal conditions and extrapolating the results to the more 
complex field conditions encountered in planetary explora- 
tion simulations. This pragmatic approach produces results 
directly applicable to the WLAN product line being used and 
accounts for all variables, including interactions between 
network protocol stacks and applications. (As a side note, we 
have found significant similarities between different vendor’s 
products based on the 802.11b protocol, so we consider the 
test results generally applicable to WLAN design.) 

5. Internet Protocol Domain 

The Transport Control Protocol for the Internet Protocol (TCP/ 
IP) implements data sockets for transfer of data between com- 
puters. It resides one level above the MAC physical transport 
layer and creates a mechanism for creating virtual logical 
connections between machines using an IP address r socket 
number tuple. This is the level at which application program- 
mers deal with the network and is therefore accessible to ap- 
plications that can be used for measuring network through- 
put and latency at the IP level. There are many tools to do 
this and we use a variety of techniques to crosscheck results. 
As in all complex systems, the exact method of measurement 
can affect the results. 

One easy way to measure sustainable throughput is to down- 
load a file from an FTP server using an FTP client across the 
network link under test. Simply dividing the file size by the 
time gives us sustainable average throughput. The comput- 
ers must be fast enough to serve the FTP data and consume 
the FTP data so that network performance, and not computer 
performance is the dominant bottleneck. We use file sizes of 
several Mbytes, which take a few minutes to transfer over a 
typical WLAN. 

There are network analyzers and packet capture programs 
such as Novell’ s Lanalyzer that also provide throughput num- 
bers by looking at all packets being transferred through the 
network. Of course, some application has to be using the net- 
work and saturating the capacity to get meaningful numbers. 
We often use this technique for analyzing network manage- 
ment packets and specific circumstances of network usage 
by programs. These can be used in conjunction with the FTP 
file transfer method described above. There are applications 
such as TTCP [8], iPerf [9] and Qcheck [10] that are specifi- 
cally designed for network testing and are publicly available 
as shareware or freeware. We use all three and compare their 
results to the FTP benchmarks. These crosschecks are very 
valuable, because under certain circumstances, one measure- 
ment tool may produce very different results from the others. 
Knowing the detailed mechanisms used by these tools for 


benchmarking performance allows a skilled network engi- 
neer to infer the basic cause of such anomalous phenomenon. 

The PCATTCP product is a port of the original BSD tool 
TTCP for use at a Windows command prompt to initiate 
winsock socket connections at the application layer between 
the client and server. In a crosscheck of validation between 
iPerf and PCATTCP, results showed very similar throughput 
numbers with PCATTCP slightly lower in all but one test 
configuration. iPerf was chosen as the preferred method of 
testing not as a result of these validation tests, but for provid- 
ing greater ease of use and a wider availability of testing 
options. 

Using iPerf in a client/server mode involved setting up a laptop 
computer on both ends of the link to be tested and running 
the program from the client side. Throughput numbers were 
recorded in most cases as an average of several iterations or 
as the highest and lowest observed values over a minimum 
of 3 iterations. Default mode of operation is to send 16776000 
bytes of data from client to server and record the time it takes 
to send. Throughput is calculated by dividing the amount of 
data sent by the time taken to send it. 

NetlQ Qcheck works in a similar manner except that it is 
driven by a graphical interface and only needs endpoint soft- 
ware to be installed rather than running the program on both 
ends. Qcheck sends a default of 100 bytes during testing and 
throughput calculations are made in the same manner as iPerf. 
From a white paper describing the tool: 

Calculations of throughput and response time are based 
on the number of bytes sent and received from the 
application’s perspective. Qcheck’s throughput mea- 
surement is lower than the throughput that you would 
see with a network protocol analyzer. Qcheck measure- 
ments reflect only the data payload — what an applica- 
tion user would see — without the protocol overhead, 
such as headers, trailers, flow control, connection setup, 
and retransmissions. [11] 

Qcheck generated a wider range of values in testing, presum- 
ably from the smaller amount of data being sent, so results 
from a minimum of 5 iterations were averaged during through- 
put data collection. The fundamental difference between 
Qcheck and iPerf, which may have led to differing results 
during our tests, is in the amount of data they send. This af- 
fects the duration of the test and therefore the averaging in- 
terval. iPperf transmits a set amount of information and de- 
termines the time it takes for the information to be received, 
while Qcheck sends an information stream for a set period of 
time at a predetermined window size and determines how 
much is received. 
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Graph 4 - Network Throughput — Sector Panel to Dipole 


Network Throughput Test Results 

The most important information that comes out of network 
throughput benchmarking is the ability to understand the sus- 
tainable throughput available to applications for a given 
WLAN configuration. The number of variables in WLAN 
performance makes it nearly impossible to predict perfor- 
mance under actual field conditions particularly for long links 
incorporating repeaters. However, the network throughput 
results obtained from our calibration tests do produce first- 
order correlation of network throughput with RF signal lev- 
els, allowing prediction of network performance for a given 
link segment. Network throughput tests are performed at ev- 
ery data point right after the RF measurements are made, 
without changing anything. Network throughput is rather 
predictable and repeatable at short distances, but this is not 
true at longer distances. The MEX backbone is also a repeater- 
based system, with up to two repeaters used to extend the 
range of the system. Repeaters can have a remarkable effect 
on network throughput, especially if they are half-duplex 
mode. The Cisco bridges operate as half-duplex repeaters, 
only being able to either transmit or receive at any given time. 
[12] They spend half the time receiving an incoming packet 
and the other half re-transmitting it to the far end of the chain. 
Half duplex essentially halves the throughput by reducing 
the duty factor by two. 

There are two distinct mechanisms by which WLAN through- 
put is reduced. The first mechanism being a high BERR, re- 
sulting in packet loss, necessitating packet retransmission. 


and reducing throughput. The second is the effect of variable 
latency, primarily caused by processing delays in long WLAN 
chains of multiple repeaters. Latency effects are also caused 
by packet loss though, so the two effects can interact to re- 
duce throughput even more. Increasing the signal strength or 
quality can mitigate the first effect by reducing BERR and 
increasing TCP/IP window size can reduce the second effect. 
A quantitative analysis of WLAN throughput under various 
conditions allows separating the two causes and optimizing 
both parameters properly. 

The MEX project, using iPerf and Qcheck, measures net- 
work throughput and latency at various distances in our out- 
door test range, varying the antenna configurations to gener- 
ate a wide range of performance data for each WLAN prod- 
uct line. Two network throughput curves are generated, the 
first for the ATV to repeater link L2 (the same link tested for 
RF signal strength), and the second for the aggregate through- 
put through Link LI and L2, from ATV through repeater to 
base. 

The same test cases used for RF domain analysis are used to 
demonstrate the effect of link segment distance on network 
throughput. There are multiple effects that produce rather 
complex behavior for these graphs. The first case is the re- 
peater-to-ATV link, using a sector panel-to-dipole antenna 
configuration shown in Graph 4, above, corresponding di- 
rectly with the RF signal strength example. The top curve 
(repeater) shows a typical graph of diminishing throughput 
with increasing distance between ATV and repeater, repre- 
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senting the Link 2 under test. A maximum of 5.9 Mbps is 
obtained, nearly the maximum expected from an 1 1 Mbps 
raw data rate WLAN link. WLAN protocols have a great deal 
of overhead and usually can only fill the raw data pipe by 
about 50%. A typical figure for a wired LAN is about 80%. 
The throughput hits a peak around 300 meters, another typi- 
cal behavior observed in previous 802.1 lb tests. [13] Finally, 
at longer distances, the graph shows a linear decline of 
throughput with distance, again fairly typical for WLANs. 

The lower curve shows the throughput from the ATV through 
the repeater to the base. It exhibits half the throughput of the 
top one, graphically illustrating the factor of two reduction 
of throughput that occurs using a half-duplex repeater. How- 
ever, at longer distances this relation no longer holds true, 
the throughput with the repeater is a bit better than a factor of 
two. This is because the longer link L2 dominates the through- 
put measurement due to its higher latency compared to the 
shorter repeater to base link. 


The second test case (see Graph 5, below) involves the use 
of a Yagi antenna at the ATV, resulting in significant extra 
RF signal for L2 and greater throughput at farther points. For 
example, in the top curve for L2, 4000 Kbps is achieved at 
620 meters with the Yagi and at only 400 meters for the di- 
pole, showing correlation of network throughput with RF sig- 
nal strength. The bottom curve, ATV to base shows 2000 
Kbps at 350m for the dipole and 580m for the Yagi. How- 
ever, there are more complex phenomena at work. At 840 
meters, the Yagi is showing somewhat decreased throughput 
compared to the dipole, with both L2 and L1+L2 data points 
showing lower numbers than expected. 



Graph 5 - Network Throughput — Sector Panel to Yagi 
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Graph 6 - Network Throughput — Sector Panel to Yagi, New Firmware 


The third test case uses the same Yagi antenna as the second 
test case, but with upgraded bridge firmware. This is the same 
upgrade that solved the RF signal level measurement error, 
and many changes to the MAC layer timing were also made, 
necessitating generation of more throughput test results for 
the new firmware. Graph 6, above, shows the results of just 
the firmware upgrade on the network throughput, since all 
other equipment remained the same. 

We observe a real increase in network throughput for L2 
shown in the top curve. The numbers just stay higher over 
more distance. The same is true for the L1+L2 curve at short 
distances; however, at 500 m and at 840 m, the throughput 
from ATV through repeater to base is significantly lower than 
it should be. The throughput at 500 m should be 2400 Kbps, 
but it is 1800 Kbps. At 840 m, it should be 1800 Kbps, but is 
only 460 Kbps. This number is an average of the results of 
iPerf and Qcheck and is accurate. There is an effect occur- 
ring in the test range at the furthest data point which reduces 
throughput for certain tests, and it is not repeatable from test 
to test We have reviewed all experimental controls and find 
that the variation of throughput has some patterns and is not 
the result of experimental error. 

One hypothesis is that ground scatter reduces throughput, and 
further analysis was performed by comparing multiple test 
results from the old firmware and new firmware test cases. 
The analysis produced an unexpected result. The far end 
throughput at 840 m using the old firmware produced gener- 
ally lower results than expected, with quite a bit of variation. 


In contrast, the new firmware produced results in which the 
L2 far-end throughput was generally much better. The firm- 
ware upgrade reduced throughput variations at the far end of 
L2, generally producing consistently higher throughput over 
multiple tests. 

The old firmware gave good results for the combined L1+L2 
throughput, generally over 1 Mbps. However, the new firm- 
ware gave consistently lower numbers for throughput back 
to the base through L1+L2, generally under 0.5 Mbps. Each 
individual segment, LI orL2, provided high throughput but 
the combination did not! A new hypothesis is emerging from 
this, which can only be inferred from multiple tests. Since a 
firmware upgrade will not affect basic radio performance, 
but does affect MAC layer timing, we must conclude that 
these throughput variations are basically caused by the com- 
plex timing interactions occurring in the MAC layer respon- 
sible for RF packet acknowledgement, media access and co- 
ordination, and repeater turnaround time. Low throughput 
using the repeater could be caused by higher latencies result- 
ing from the firmware upgrade. The conclusion is that 
throughput across a repeater chain can be affected by numer- 
ous factors, and that we do not yet understand nor control all 
these factors. Future work will include detailed timing mea- 
surements of various aspects of network data transfer em- 
ploying both packet protocol analyzers and network protocol 
analyzers for the MAC and TCP/IP layers respectively. 
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Finally, we ran our full configuration consisting of two re- 
peaters. For this test, we placed a second repeater at the far- 
thest point along Link 2 at 840 m and varied the distance of a 
third link L3, perpendicular to link L2. Link L3 ran the length 
of another remote road with no obstacles. The first repeater 
now used two 18 dBi small-dish grid antennas on a single 
mast, each aligned for best signal strength, while the second 
repeater used an 18 dBi small-dish antenna along L2 and a 
13 dBi sector-panel antenna for link L3 to the Yagi mounted 
on the ATV. Waypoints were established and data taken at 
100, 200 and 300 meters for L3. Link L2 was fixed at 840 
meters of length. 

Table 5, below, shows the results of two test runs at 300 
meters for L3 using the old firmware. The RF signal strength 
was very good for both L2 and L3 and the corresponding 
throughput numbers are also quite high. Observe that the first 
repeater generally results in a reduction of a factor of two in 
throughput due to half duplex duty cycle, but that the reduc- 
tion of adding the second repeater is not another factor of 
two, which might be expected. Rather, there is some overlap 
between the two repeaters’ duty cycles which reduces the 
throughput reduction effect of the second repeoter The over- 
lap is about 50%, which significantly improves throughput 
for multiple repeater chains. For these tests, it is important 
that the test range be large enough for the ATV to be unaf- 
fected by the first repeater or the base station. 

Latency and Window Size 

Latency is defined as the response time for transferring packet 
data. This is a complex interaction of the transmit time, the 
round-trip-time (RTT) of the physical medium (light speed 
delays) and the time requiied to send an acknowledgement. 
Light speed delays would be on the order of 3 usee for a 1 
Km link, and computer response times are on the order of 1 
msec or less. Of more significance are the data buffers in 
various network components that increase transport delay 
times as well as related processing steps such as generating 
an acknowledgement. We use a feature of Qcheck that sends 
16KB of data and measures the response time. For a single 
WLAN hop of 840 m, we see latencies of about 34 msec with 
about one of five measurements yielding higher numbers 
between 34 to 100 msec. The maximum seen was 150 msec. 
This latency scales directly with link length and is dominated 


by processing delays in the network hardware. 

A basic primer in network TCP/IP function provides insight 
into a particular behavior of these network stacks that has a 
direct impact on network throughput. The “window size” is 
the size of the network buffer used to aggregate data into a 
series of TCP/IP packets that require a single acknowledge- 
ment. For example, Microsoft Windows uses 8 KB window 
sizes by default. For 1.5KB packet sizes typical of WLAN 
MAC layers, this translates to about 6-7 packets of data be- 
ing sent before the recipient returns a single acknowledge- 
ment to the sender. If any errors occur in the transmission, 
the entire 8 KB buffer is sent again, incurring a significant 
throughput penalty because this doubles the time required to 
send that 8KB chunk of the file, halving the throughput. Nei- 
ther the MAC layer nor the TCP/IP layer returns errors in the 
event of single packet loss; rather each layer automatically 
resends the packet and does not report statistics on this pro- 
cess. Only if the loss of packet transfer is persistent do these 
layers report an error and abort the transfer. Therefore, high- 
level application layer TCP/IP network bandwidth measure- 
ments are used to provide indirect measurements of MAC 
layer error rates and performance characteristics. 

There is another consequence of window size with respect to 
network latency that causes significant network throughput 
problems, particularly with satellite links or long WLAN seg- 
ments. Recall that one window-size buffer is sent and requires 
a single acknowledgement that is received after the RTT delay 
of the link. For an 8 KB window-size default buffer and 1 
msec RTT delay typical of wired LANs, this produces a theo- 
retical maximum throughput of 8KB/msec or 8MB/sec or 64 
Mbits/sec (Mbps). Obviously, this will not create a problem 
for medium performance networks with only 1 00 Mbp~ of 
raw data rate. However, note what happens on a space-based 
satellite link to a geosynchronous-orbit satellite. The distance 
is over 50,000 miles, incurring a light-speed delay of about 
0.6 seconds round-trip. In this case, the 8KB window size 
produces 8KB/0.6 sec or 13KB/sec for only 107 Kbps, far 
below the communication link data rate for many satellite 
links. Therefore, the effect of small window size interacting 
with communication latency can be the most significant vari- 
able in satellite communications. The obvious solution is to 
increase window size, something done in the registry or net- 
work stack parameter file. 


Table 5. Two-Repeater Configuration Throughput 


Measurement 

LI + L2 + L3 

L2 + L3 

L3 



-33 (L2) 

-45 

Throuahoutl (KbDsl 

1388 

1897 

3599 
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1610 

2756 

4664 
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Table 6 - Network Throughputfor Various Latency and Window-size Values 


Latency (msec) 

8KB Window (Kbps) 

16KB Window (Kbps) 

32KB Window (Kbps) 

Typical for 

1 

64000 

128000 

256000 

LAN 

10 

6400 

12800 

25600 

WLAN short link 

50 

1280 

2560 

5120 

WLAN long link 

100 

640 

1280 

2560 

WLAN backbone 

200 

320 

640 

1280 


400 

160 

320 

640 


600 

107 

213 

427 

Geosync Satellite 

800 

80 

160 

320 


1000 

64 

128 

256 



Window size cannot be increased arbitrarily however. If a 
single bit error occurs in the transmission of the buffer, the 
entire buffer must be retransmitted. Therefore, for any com- 
munication link there is an optimum setting, which balances 
network throughput restrictions caused by too small a win- 
dow size with the throughput reduction caused by a high re- 
transmission rate. The same analysis can bs applied to 
WLANs, which have latencies ranging from tens of millisec- 
onds to hundreds of milliseconds. We have seen latencies of 
500 msec on links employing multiple repeaters. Table 6, 
above, shows the bandwidth restrictions caused by latency 
effects using 8KB, 16KB and 32KB buffers. This indicates 
that larger buffers are more appropriate for wireless links. 
Increasing window size to 16KB in our WLAN tests has gen- 
erally raised throughput 10%, indicating average latencies 
are still rather short. Perhaps this effect explains the reduc- 
tion in net throughput through a repeater that was observed 
with the new firmware. If the new firmware increases overall 
latency of data transfer, by slowing down repeater turnaround 
for example, this would appear as a reduction of net through- 
put even though the individual segments have high through- 
put. For a restriction to only 500 Kbps for a default 8KB 
window size, the average L1+L2 latency would have to be 
around 150 msec, which is not an unreasonable value. More 
testing will be performed to confirm this possible explana- 
tion. 

6 . WLAN Design and Deployment 

The design and field deployment of a WLAN system draws 
upon all of the domains presented. The RF analysis is ap- 
plied at the design phase to ensure link strength and quality 
for the chosen link distance. This means calculation of link 
margin to ensure that adequate antennas are being specified 
together with antenna mounting masts of sufficient height to 
reduce the effects of the Fresnel zone for the range desired. 
One should always strive to reduce parasitic losses by using 
minimum cable lengths and high-quality cables and connec- 
tors. Adequate quality control of components is needed to 
prevent significant loss of radio signal strength due to sloppy 
construction of cables. Parasitic losses are significant and must 


be properly estimated for the link calculation. Output trans- 
mit power, receiver input sensitivity and antenna gain speci- 
fications are also needed to complete the link calculation. 
Large margins for RF link strength should be allowed, since 
theoretical calculations neglect many losses that occur in the 
field. The design phase is completed once the system is speci- 
fied and expected performance detailed 

During field deployment and testing, the design information 
can be used to determine how well a specific link is perform- 
ing. This is done by comparing the field test results to design 
values or expected results. For example,, our MEX 2003 sec- 
ond repeater hop covered a distance of over 2.6 miles be- 
tween two high hills using two grid dish antennas. At this 
distance, one could not see the other repeater and even a spot- 
ting scope did not resolve the thin antenna mast on the far 
hill. We had trouble actually identifying which hill the re- 
peater was mounted on at that distance, since there were so 
many hills at the Utah field site. Figure 4, next page, shows 
the far end repeater and antennas, with the sector panel an- 
tenna completing the link to the ATV. We used the antenna- 
alignment tool from the second repeater location to deter- 
mine RF signal strength numbers for this long link, and used 
it for pointing the antenna. The procedure was to first opti- 
cally align the antennas by eye, then use the antenna align- 
ment tool to adjust azimuth and elevation until maximum sig- 
nal was obtained. However, both antennas needed to be 
pointed accurately to obtain best performance, so the far an- 
tenna was aligned by a second communication engineer at 
the far site communicating with the first engineer using a 
walkie talkie. This procedure is labor intensive and small 
adjustments to antenna alignment can have a big effect on 
RF signal strength at large distances. For example, we were 
able to go from 1% signal strength to 18% signal strength by 
simply aligning the antennas accurately. This was about a 
10-fold increase in actual signal power. 

How well did we do on the repeater placement and antenna 
alignment? We measured the RF signal strength at the sec- 
ond repeater site at -86 dBm using the antenna alignment 
tool. This resulted in 1 8% signal strength and good signal 
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quality numbers. If we extrapolate from the calibration curves 
we find that this measured value corresponds to roughly-68 
dBm theoretical signal strength at the far end of the link. 
Here’s where we tum the equations around and determine 
the predicted theoretical range corresponding to this theo- 
retical signal strength using two 18 dBi grid antennas. This 
predicted distance was 4.9 miles compared to an actual dis- 
tance of 2.6 miles. We achieved over 55% of predicted range, 
a reasonable value for rough terrain. In dB values, we lost 
about 6 dB of link margin (half the distance needs one-quar- 
ter the power) beyond theoretical, which means there were 
no gross errors in setup or alignment. This value also gives 
us an approximation for additional losses over this distance. 

Our throughput calibration curves can give us some indica- 
tion of expected throughput under various field conditions. 
We simply find the comparable RF field strength number and 
look at the corresponding throughput that resulted. This is an 
approximation, but a reasonable one if applied to a single 
link segment. The distances must also be comparable for this 
to be true, for similar RTT. A very rough interpretation ap- 
plied to the second repeater hop described above would yield 
q link segment throushpnt of between 2 to 3 Mbps. This would 
correspond to a network throughput from habitat to ATV of 
about 0.5 to 1 Mbps, based on the double repeater calibration 
tests. Our only problem was that after a strong wind came up 

Figure 4 


in the afternoon, the repeater masts and antennas started sway- 
ing and this was reflected in network throughput fluctuating 
in sync with the swaying! 

While rough estimation of throughput can be achieved by 
extrapolating the calibration data, significant variability in 
end-to-end network throughput has been observed under a 
wide variety of conditions particularly at longer distances. 
The working hypothesis is that these variations are caused by 
long and highly variable latencies in packet transmission 
caused by timing interactions and/or high BERR primarily at 
the MAC layer, but also in the TCP/IP layer and applica- 
tions. Most of the time, we see that and Qcheck provide very 
similar values for throughput, but occasionally they differ 
significantly. When this occurs, we take many throughput 
measurements using both tools and even repeat the entire 
calibration run to ensure accuracy. The throughput measure- 
ments presented in the graphs represent an average of sev- 
eral test measurements using both iPERF and Qcheck. The 
variations persist and are repeatable, from a statistical view- 
point. We need detailed and accurate measurements of la- 
tency at numerous points in the WLAN system to analyze 

tVue nhpnnmpnnn 

The variability of WLAN throughput performance despite 
stringent controls placed on our test range supports our em- 
pirical method for WLAN metrics. There are too many un- 
predictable timing variations and interactions which couple 
with a variety of packet data loss mechanisms to allow linear 
analysis. This leaves detailed modeling and simulation and 
controlled field tests as the only methods that work for these 
highly complex systems. It is recommended that network 
throughput and latency measurements be employed to bench- 
mark every WLAN installation particularly for long-haul re- 
mote field use. The MEX project is looking at automating 
WLAN metrics data collection. 

Figure 5 
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Figure 5 (preceding page) shows the author placing a phone 
call over the MEX backbone WLAN to the habitat over 5 
miles away. At this distance, our walkie talkies would not 
work and this was the only way to speak to people in the 
habitat to coordinate the simulations. We had good voice 
quality on the VoIP telephones concurrent with inter-agent 
messages being sent by the Mobile Agents software, with 
occasional background FTP file transfers. The network per- 
formed its required functions and even supported the voice 
link. 

7. Conclusion 

The MEX project has defined a pragmatic method of WLAN 
analysis and engineering applicable to a wide range of prod- 
uct lines and specifically addressing long-haul WLANs for 
use in rugged terrain. A method of experimentally reconcil- 
ing WLAN site measurement tools with radio theory has been 
developed that correlates well with data from field deploy- 
ment. Calibration curves that normalize WLAN RF signal 
strength data with theoretical calculations allow numerous 
site survey tools supplied by WLAN product vendors to be 
applied with consistency and certainty even in hybrid net- 
works. Furthermore, the methods can be used to normalize 
and calibrate a variety of instruments including packet ana- 
lyzers and spectrum analyzers. Additional losses due to 
Fresnel zone obstruction, atmospheric absorption and 
multipath distortion must be accounted for, requiring signifi- 
cant additional margins in the RF link calculations. 

The correlation of network throughput to RF signal strength 
is valid only for a single link segment provided the link dis- 
tance and antenna configuration are the same. The through- 
put measurements are not repeatable at long distances or 
through multiple repeater chains due to factors that appear to 
be complex timing interactions at the MAC layer. These tim- 
ing interactions are affected by link distances and vary even 
if the physical configuration of the WLAN remains constant. 
Despite maintaining fully controlled test conditions, we saw 
variations in throughput between measurements and from test 
run to test run that could not be explained. There was a statis- 
tical pattern to the variations, indicating this was not a mea- 
surement artifact or error. For example, the 840 m through- 
put was low for 5 of 10 measurements using the old firmware 
but for only 2 of 10 using the new firmware and this per- 
sisted over several mns performed on different days. Although 
RF signal strength was very consistent and repeatable from 
test to test, throughput was not. Consistent RF signal strength 
validated our experimental controls, so throughput variations 
were not an artifact of the test range or procedures. 

In summary, WLAN design is best accomplished by using 
RF link analysis to assure adequate link margin. Subsequently, 
these RF signal strength margins can be verified in the field 
to validate the effectiveness of the field setup and alignment. 
Throughput in such complex hybrid WLAN systems is best 
determined experimentally to give software developers and 


application end-users some expectation of network perfor- 
mance. Throughput may vary even for fixed WLAN con- 
figurations and this needs to be taken into account by 
applications. 
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